A COMPOSITIONAL SHUFFLE CONJECTURE SPECIFYING 
TOUCH POINTS OF THE DYCK PATH 



J. HAGLUND, J. MORSE, AND M. ZABROCKI 

Abstract. We introduce a g, t-enumeration of Dyck paths which are forced 
to touch the main diagonal at specific points and forbidden to touch elsewhere 
and conjecture that it describes the action of the Macdonald theory V operator 
applied to a Hall-Littlewood polynomial. Our conjecture refines several earlier 
conjectures concerning the space of diagonal harmonics including the "shuffle 
conjecture" (Duke J. Math. 126 (2005), pp. 195 - 232) for Ve n [X]. We 
bring to light that certain generalized Hall-Littlewood polynomials indexed by 
compositions are the building blocks for the algebraic combinatorial theory 
of q, t-Catalan sequences and we prove a number of identities involving these 
functions. 



1. Introduction 

Our study concerns the combinatorics behind the character of the space of diag- 
onal harmonics DH„ and identities involving Macdonald polynomials that can be 
used to form expressions for this character. At the root of this theory is a linear 
operator V, introduced in [BGHT99i, under which the modified Macdonald poly- 
nomials H^lX-jq, t] are eigenf unctions. [Hai02 proved that the Frobenius image 
of the character of DH„ equals Ve„. This gives an explicit expression involving 
rational functions in q, t for the multiplicity of an irreducible indexed by a partition 
A in the character of DH„. 

An important open problem in this area is the "shuffle conjecture" of HHLRU05 
which asserts that the coefficient of m\ in Ve ra simplifies to a q, t statistic on lattice 
paths. A major breakthrough in this direction was made with the conjectured 
combinatorial formula of |Hag03| for the coefficient of myn = s±n in Ve„. In this 
case, the coefficient is a bi-graded version of the sign character and it is called 
the q,i-Catalan C n (q,t) since it reduces to the nth Catalan number when q = 
t = 1. The combinatorial formula for C n (q,t) was proven in [GHOlJ, GH02] and 
pursuant work Hag04 also settled the shuffle conjecture for partitions of hook- 
shape. However, the general case remains a mystery. 

An unrelated study of Macdonald polynomials led to the discovery |LLM03| of 
a new family of symmetric functions called fc-Schur functions s^[X; t] which were 
conjectured to refine the special combinatorial properties held by Schur functions. 
The fc-Schur functions have a number of conjecturally equivalent characterizations 
and it has now been established in |LM08l Lam08 that those introduced in [LM07] 
refine combinatorial, geometric and representation theoretic aspects of Schur theory. 
This prompted Bergeron, Descouens, and Zabrocki to explore the role of fc-Schur 
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functions in the q, i-Catalan theory. To this end, they conjectured in [BDZlOj that 
the coefficient of Si»> in Vs^» [-X";f] is a positive polynomial in q,t and they proved 
their conjecture for the case that t = 1. 

Our work here was initially motivated by a desire to find a combinatorial de- 
scription for this coefficient in general, ideally in terms of a q, t-statistic on lattice 
paths as with the q, i-Catalans. We found such a description, but more remarkably 
this led us to discover that a natural setting for the combinatorial theory of DH n 
is created by applying V to the general set of Hall-Littlewood polynomials indexed 
by compositions. To be precise, it was proven in |LM03I that the fc-Schur func- 
tion s$[X;t] is merely a certain Hall-Littlewood polynomial. This led us to study 

V on a Hall-Littlewood polynomial indexed by any partition A. But in fact, our 
work carries through to the family of polynomials C a [X; q], for any composition a, 
defined in terms of operators similar to Jing operators. 

A key component in the proof of the q, ^-Catalan conjecture [GH02] is the use 
of symmetric functions E n ^\X;q\ which decompose e n into pieces that remain 
positive under the action of V. We have discovered that the C a [X;q] can be 
used as building blocks in the g,t-Catalan theory that decompose the E n> k[X;q] 
into finer pieces, still positive under the action of V. Our conjectures on these 
building blocks thus refine earlier conjectures involving E n ^[X;q], the conjectures 
in [BDZ10 , the shuffle conjecture, and the conjectures in BGHT99 asserting that 

V applied to Hall-Littlewood functions have q, i-positive Schur coefficients. Loehr 
and Warrington [LW08 introduced an intricate conjecture for the combinatorics of 

V applied to a Schur function s\. Our conjecture is extremely simple, describes the 
action of V on a larger set of symmetric functions than just a basis, and refines the 
conjecture of Loehr and Warrington when V acts on the Schur function s/ n _f.^k\ 
[LW081 Conjecture 3] as explained at the end of Section |4j 

Garsia, Xin, and Zabrocki GXZ10J using work of Hicks |HiclO| have now proven 
our generalized q, i-Catalan conjecture and expanded the result giving a "composi- 
tional q, i-Schroder" theorem. 



2.1. Combinatorics. A Dyck path is a lattice path in the first quadrant of the 
zy-plane from the point (0,0) to the point (n,n) with steps +(0,1) and +(1,0) 
which stays above the line x — y. For a Dyck path D, the cells in the i th row are 
those unit squares in the xy-plane that are below the path and fully above the line 
x = y whose NE corner has a y coordinate of i. The set of Dyck paths from (0, 0) 
to (n, n) will be denoted DP n and the number of paths in this set is well known to 
be the Catalan number 



For a Dyck path D, let a% — di{D) equal the number of cells in the i th row of 
D. It is always true a\ = and < a«+i < a* + 1. We define the arm sequence 
arm(_D) = (oi, 02, • ■ ■ , a n ) and note this completely determines D. We consider two 
statistics (non-negative integers) on Dyck paths. The area statistic is the number 
of whole cells which are below the path and above the diagonal, or 



2. Definitions and notation 




n 




i=l 
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The dinv statistic is defined as 

dinvp) = J2 *( a i - a i e {°> X » 

l<i<j<n 

where x(true) = 1 and x(false) = 0. 

Remark 2.1. The Dyck path D with arm sequence (0 n ) has area(-D) = and 
dinv(f) = (™). The Dyck path D' with arm sequence (0, 1, 2, 3, . . . , n — 1) has 
area(D') = (!J) and dmv(ZT) = 0. 




arm sequence (0,0,0,0,0) (0,1,2,3,4) (0,1,2,2,1) (0,1,0,1,0) 
area 10 6 2 

dinv 10 4 7 

Remark 2.2. The original proof of the combinatorial interpretation of the q,t- 
Catalan was stated in terms of a third statistic bounce(D). Since we are more 
cleanly able to formulate our results in terms of the dinv(Z?) statistic we choose 
to state all the results in this paper in terms of the dinv(D) statistic however 
the reference |Hag08, p. 50] describes an automorphism <fi on DP" such that 
area(0(£>)) = bounce(D) and dinv(0(D)) = area(£>). 

We make use of a partial order on Dyck paths; namely D\ < D 2 if arm(Di) < 
arm(Z?2), component-wise. In this case we say that D\ is 'below' D 2 because D\ 
will not cross D 2 and is hence weakly 'between' D 2 and the diagonal. 

A composition a of n, denoted a ^ n, is an integer sequence a = (ot\ , a.2, ■ ■ ■ , ot r ) 

with at > 1 and where |a| = ai+a 2 -\ \-a. r = n. The length of a is t(a) — r. We 

shall also use ta 7 = {a.H a \, a^r a )_i, . . . , a2,a%). For any composition a, we define 

(2.1) n(a) = ^(i - l)at . 

The descent set of a composition a is defined to be 

Des(a) = {ai, ot\ + a 2 , ■ ■ ■ , «i + a 2 H h a<( a )-i} • 

There is a common partial order defined on composition a, /3 |= n by letting a < /3 
when a is 'finer' than /3, i.e. Des(/3) C Des(a). If a is a composition of n, DP (a) 
represents the Dyck path consisting of a\ steps in the North (0, 1) direction followed 
by a% steps in the East (1,0) direction, a 2 (0, 1) steps followed by a 2 (1,0) steps, 
etc. 

A partition A = (Ai, . . . , A r ) is a non-increasing sequence of positive integers. 
When A is a partition of n, denoted A h n, |A| = — n - The length of A is 

£(X) = r. Given a partition A, we set 

(2.2) m(A) = (m 1 (A),m 2 (A),m 3 (A),--- ,m, A |(A)), 

where the numbers m, (A) represent the number of parts of size i in A. The conjugate 
of a partition A is the partition A' = (A' 1; X' 2 , . . . , \' m ) where A^ is the number of parts 
of A that are at least i. Partitions are generally considered to be compositions with 
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parts arranged in non-increasing order. Hence, notions defined on compositions 
apply to partitions as well. Generally, we will use the symbols a, /3, 7 to represent 
compositions and A,/z, v for partitions. 

For a given Dyck path D, touch(D) denotes the composition 7 = (71,72, ■ • ■ ,7^(7)) (= 
n that specifies which rows the Dyck path 'touches' the diagonal. That is, for 
arm(_D) = (ai, 02, . . . , a n ), = if and only if /c = 1 or fc — 1 € Des(7). The title 
of this paper comes from the notion of the touch composition. By requiring that 
touch(Z?) = a for a fixed composition a, we have specified that the Dyck path will 
touch the diagonal in rows 1, 1 + 1 + -\-0t2, ■ ■ ■ f 1 + au +Qf2 + • • • + cti(a)— 1 an d 
is forbidden to touch the diagonal in the other rows. Note that under this defini- 
tion, we view all paths as touching the diagonal in row 1, but none touching in row 
n + 1, and we say the path touches the diagonal £(a) times. The partial order on 
compositions is consistent with the partial order on Dyck paths in the sense that if 
Di and D2 are Dyck paths such that D\ < D2, then touch(£>i) < touch(£>2)- 

Using these notions we introduce a new statistic doS a (D) for a given Dyck path 
D with touch(Z?) < a. If arm(D) = (ai, (J2, . . . , a„), let n be the number of rows 
such that ai — for 1 < i < a\, be the number of rows such that — for ot\ < 
i < ol\ + ot2, and more generally = #{i : ai = and Ylj=i oij < i < Y^j=x a j}- 
We then set 



Remark 2.3. If arm(-D) = (0,1,2,0,1,2,2,1,0,1,2,3,2,1), then touch(D) = 
(3, 5, 6). Taking a = (8, 6) we have doff (8 ,6) (D) = 2. 



The only Dyck path with touch(D) = (1™) has arm(L>) = (0"). There are C„^i 

Dyck paths with touch(D) = (n) and more generally there are nfio. ^a<-i Dyck 
paths such that touch(_D) = a. Note that if D and E are two Dyck paths with 
touch(L>) = touch(£ l ) < a, then doft a (D) = doS a (E). 

The results we mention so far are stated in terms of Dyck paths, but we will 
require the notion of parking functions to state the generalization of the shuffle 
conjecture. For a Dyck path D in DP 11 with arm(D) = (01, . . . , a n ), let WPd be 
the set of words of length n in the alphabet {1,2, ... ,71} such that Wi < lUi+i if 
ai < a l+1 . We use the notation x w to denote the monomial We 



(2.3) 
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also define an extension of the dinv statistic for words in WPd by setting 

dinv(w) = : 1 < i < j < n, a, = aj and Wi < Wj}\ 

+ \{{i,j) ■ 1 < i < j < n,a,i = cij + 1 and u>i > Wj}\ . 

2.2. Symmetric functions. Let X represent a sum of an infinite set of variables 
X = x\ +X2 +X3 + • ■ • considered as elements of the ring of polynomial series in an 
infinite number of variables of bounded degree. For r > 0, let p r represent a linear 
and algebraic morphism which acts on polynomial series by p r [x] — x r . That is for 
two polynomial series of bounded degree A and B, 

Pr [A + B] = Pr [A] + Pr [B] 
Pr [A-B] =p r [A] - Pr [B] 
Pr [AB\ = p r [A]p r [B] 

and in particular, p r [X] represents the r th power sum in 

the variables {x%, x 2 , x 3l . . .}. The ring of symmetric functions over the field F is 
defined to be the polynomial ring 

A = F\ Pl [X],p 2 [X},ps[X],...] . 

For our purposes, we choose the field F to be the ring of rational power series in 
the variables q,t,u,z over Q where each of the parameters q,t,u,z all have the 
property that p r [a] = a r for each a = q,t, z, u. 

Generally our symmetric functions / will be considered as polynomials in the 
elements p r and then the notation f[A) represents / with each p r replaced by p r [A]. 
The degree of p r is r and the degree of a symmetric function / is determined by 
the degree of the monomials in the power sums which appear in /. Following the 
notation of Macdonald [Mac95 , we have the power sum basis Schur basis 

s\ [X] , homogeneous basis h\ [X] , and elementary basis e\ [X] . 

In the expressions of variables it is useful to have a special symbol e which will 
represent a value of negative one but behaves differently than a negative symbol. 
If / is of homogeneous degree r, 

f[eX] = (-1)7(1] 
f[-eX\=cj(f[X\) 

where u is an involution on symmetric functions such that ui(p\[X\) = (— 1 ) I A l A )^> A [J*iT] , 
w(e„[X]) = /i n [-X"] and u(s\[X\) — s\i[X\. We will also make use of the standard 
Hall scalar product which is defined by 

(p A LY],^LY]/z M ) - (s x [X], s ^X}) - X (A = fi) 

where z M = l\i>i mi(fi)\i mi ^ . 

For any symmetric function /, multiplication by / is an operation on symmetric 
functions which raises the degree of the symmetric function by deg(f). If we define 
/ to be the operation which is dual to multiplication in the sense that 



(f ± 9,h) = (gjh), 
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then f 1 - is an operator which lowers the degree of the symmetric function by deg(f). 
It is not difficult to show that 

(2.4) f[X + z}=J2* k (hkf)lX}, 

k>0 

(2.5) f[X-z] = ^2(-z) k (eif)[X]. 

k>0 

In addition we will refer to the form of the Macdonald basis H x [X;q,t] that is 
relevant to the study of the n\ Theorem [HaiOlj and the q, t-Catalan numbers. The 
relation of this basis to the integral form J^\X\ q, t] of |Mac95| is 

Hp[X;q,t]=t n Mj M 

It is also characterized as the unique basis such that 

(H ll [X{l-\/t);q,t},H x [X{l-q);q,t])=Q 

if A ^ M and ^[X;g,t],/i„[X]J> = l. 

We are particularly interested in the Hall-Littlewood symmetric functions. Fol- 
lowing the notation of Macdonald we define the functions Q' x [X;q] to be the basis 
of the symmetric functions which satisfy 

(Q' x [X(l- q );q},Q^[X;q}) = 

if A ^ n and (Q' x [X;q],h n [X]) = q n( - x \ Relating the definitions of the Hall- 
Littlewood and Macdonald symmetric functions, we note that 

Q' x [X;q\=H x [X;0,l/q]q nW =Y, K M^l X ] ■ 

A 

The operator V was introduced in [BGHT99 and is defined by 

(2.6) VH x [X;q,t]=t n Wq n(X ' ) H x [X;q,i\ . 

This operator has been fundamental to the study of the q, i-combinatorial identities 
associated with DH n and Macdonald polynomials. Its definition is chosen so that 

(2.7) (V{e n [X]),e n [X])=C n (q,t) 

where C n (q,t) is the q, t-Catalan polynomial. References |GH011 [Hag03| [Hag08 
showed that 

(2.8) C n (q,t)= t arca(D) g dinv(D) 

DeDP" 

with the sum over all Dyck paths of length n. 

Remark 2.4. A small example is C^q, t) = q 3 + qt + q 2 t + qt 2 + t 3 , whose terms 
can be computed (in order) from the 5 Dyck paths of length 3 with respective arm 
sequences (0,0,0), (0,0,1), (0,1,0), (0,1,1) and (0,1,2): 
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We will make use of the Newton element 
(2.9) Sl[X\ = ^p A [X]/z A = h m[X] 

A m>0 

where we have the identities 

n[x + Y] = n[x]n[Y] 
n[x-Y] = n[x}/n[Y] 



fl[xi + €X2 — X3 — 6X4} = 



(l-x 3 ) (I+X4) 



(l-X 1 )(l + X 2 ) 

n[XY] = ^ SA [x] SA [r] = ^ PA [x] PA [y]/z A . 

A A 

Jing |Jin91| introduced a family of operators Elm indexed by m G Z using the 
following formal power series in the parameter z, 



(2.10) H(z)P[X] = 53 z m H m P[X] := P 



mGZ 



m6Z r>0 

He proved that these operators create the Hall-Littlewood polynomials by adding 
rows. 

Proposition 2.5. Jin9l] For any partition A = (A 1; . . . , 

Q' x [X;q\=m Xl m X2 ---m Xe (i) . 

3. TWO FAMILIES OF HALL-LlTTLEWOOD SYMMETRIC FUNCTIONS 

Our primary focus is the study of two families of symmetric functions and the 
combinatorics surrounding them. These functions arise from the following operators 
B m and C m , closely related to Jing's H m operators from equation (2.10): 



(3.1) 

and 
(3.2) 



l(z)P[X] = 53 z m M m P[X] := P 



III- '. 



X + e 



(1-9) 



tl[-ezX] 



= E z m J2(- 1 ) r ^+r[X]h r [X(l-q)] ± P{X 

.(1-9) 



{z)P[X] = ^ z m C m P[X] := —q P 



X + e- 



n{e(z/q)X) 



53 (-l/q) m - 1 z m 53 q- r h m+r [X]h r [X(l - q)]^P[X] 



r>0 



The symmetric functions of particular interest here are those defined, for any com- 
position a, by setting 



and 



P> a [X; q] — R ai!ia) M ae(ct) _ 1 ■ ■ ■ M ai (1) 
C a [X;q]=C ai C a2 ---C ae{a) (l) . 



8 



J. HAGLUND, J. MORSE. AND M. ZABROCKI 



Note that the operators generating B a and C a are both indexed by the parts of a, 
but are applied in reverse order with respect to one another. This is done so that 
the associated combinatorial and algebraic identities are more uniform. 
These operators are related by way of the equation: 

(3.3) B(z) = ujU(z)uj 
and 

(3.4) C(z) = {-qW^ l ^{-z/ q ), 
or equivalently 

(3.5) C m = (-l/qr-'M^ = (-l/q^uM^u . 
Thus the functions themselves are related as: 



(3.6) 



Q' x [X;q] =LoB^[X;q] = (-qf x ^C\{X; l/q] . 



The Jing operators create Hall-Littlcwood polynomials indexed by partitions 
which form a basis for the symmetric function ring. The C a and B a symmetric 
functions are indexed by compositions and are not linearly independent. The equa- 
tions above detail how Hall-Littlewood symmetric functions are included in these 
families and therefore, Schur positive expansions of the C a and B a hold in certain 
cases. However, they are not Schur positive in complete generality. The smallest 
examples that are not uniformly Schur positive or Schur negative are -8(3,1) [X; q] 
and C (1 , 3) [X;q\. 

Remark 3.1. Below is a table of the symmetric functions B a [X;q] and C a [X;q] 
for a \= 4. Notice that both B( 3jl )[X;g] and C(i, 3 ) [X; <?] have mixed signs in their 
coefficients. 



B 



B 



(1,1,2) 
(1,2,1) 
(2,1,1) 



[X;q] 
[X;q] 
[X;g] 
[X;q] 



B {h3) [X;q] 
B(2,2)[X;q] 
S( 3 ,i) [X;q] 
B {4 )[X;q\ 



\q 6 


q 3 + q 4 + q 5 


q 2 + q 4 


q + q 2 -\ 


-q 3 1] 


q 3 


q + q 2 


q 


1 





q 4 


q 2 +q 3 


q 2 


q 





q 5 


q 3 + q 4 


q 3 


q 2 





q 


1 











q 2 


q 


1 








q 3 


q 2 


9-1 








1 















S(i,i,i,i) [X;q] 
S(2,i,i) [X; q] 
S(2,2)[X;q] 
S(3,i)[X;q] 
S(4)[X;q] 



C 



(i,i,i,i 



(1,1,2) 
(1,2,1) 
(2,1,1) 



[X;q] 
\X;q] 
[X;q] 
[X;q] 



C(ij)[X;q} 

C( 2 ,2) [*;<?] 

C {3 ,i)[X;q] 
C (i) [X-q] 



1 q~ 3 - 


f q- 2 + q- x 


q- 4 + q- 2 


q~ 5 + q~ 4 + q~ 3 


q- 6 ] 





-q- 3 


-q- 4 


-q- 5 - q- 4 


-q- 6 





-q- 2 


-q- 3 


-q- 4 -q- 3 


-q- 5 





-q- 1 


-q- 2 


-q 3 -q 2 


-q- 1 








q 3 -q 2 


q- 4 


q- 5 








q- 2 


q- 3 


q- 4 











q- 2 


q- 3 














q- 3 



8(i,i,i,i)[X;q] 
8(2,i,i)[X;q] 
S(2.2)[X;q] 
S(3,i)[X;q] 
S(4) [X; q] 



To manipulate these symmetric functions, we derive commutation relations be- 
tween the symmetric function operators. Our first result enables us to expand 
an element C a [X;q], for any composition a, in terms of the C\[X;q] indexed by 
partitions A. 



A COMPOSITIONAL SHUFFLE CONJECTURE 



9 



Proposition 3.2. For m,n € Z, we have 

(3.7) qC m C n — C m +iC„_i = C„C m — gC„_iC TO +i 

In particular for meZ, 



(3.8) C m C m +i — -C m +iC m . 

q 



Proof. We begin with the expressions for the C-operators from equation (3.2 1. For 
ease of notation we shall use h m in place of h m [X] and h\ in place of the expression 
h r [X(l — q)]- 1 - We compute that 

h^{h m P[X]) = h m [X + (1 - q)z]P[X + (1 - q)z] 

(3.9) =Y,h m -Ml-q]P[X+(l-q)z] 

i>0 

= Y d h m -Ml-q]h^ i P[X]. 

We also know that 

( if r < , 

(3.10) h r [l-q] = ll ifr = 0, 

[l q if r > . 

These two identities imply that, 

qC m C n ={-l/q) m+n - 2 q~ r ~ S ~ i+1 h m+ r+ihn+s-Ml - <z]^f 

i>0 r>0 s>0 

= { _ l/q)m+ n-2 q- r - S - i+X h m+ r + iK + s-ihl X h^ 
i>0 r>0 s>0 

- (-l/q) m+n - 2 q-^-^h^r+iK+^h^hf- 

i>l r>0 s>0 

= { _ l/q)m+ n-2 Y^Y^Y, q-'-^Ki+r+tK+^h^K 1 - 
i>0 r>0 s>0 

- (-l/q) m+n - 2 q^^^hrn+r^+lK+s-^h^hl 1 - 

i>0 r>0 s>0 

(3.11) ={-l/q) m+n - 2 q- r ~ S - l+1 H m+ r +l ,n + s-i)h^h^. 



r>0 s>0 i>0 



where to arrive at (3.111 we have introduced the Schur function s^ a ^ = h a h 
K+ih-i- Similarly, 

r>Q s>0 i>0 
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From these identities, we find that all terms in the difference qC m C n — C m +iC n _i 
cancel except the i = term in ( 3.11J : 



qC m Cn - C m+1 C n ^ =(-l/q) m+n - 2 Y,Y,^ S+ls ^+^+s) h r ±h s 1 - 

r>0 s>0 

+ (-i/ q r+ n ~ 2 E E E <r r - s - i+l s {m+ r + i,n + s-i)K x K x 

r>0 s>0 i>l 

- (-l/qr +n - 2 E E Q-^-^m+r+i+l^+s-i-DK^ 
r>0 s>0 i>0 

= { _ 1/q yn+n-2 £ £ q-^+1 S{m+rn+s)h ^ h f . 
r>0 s>0 

We can then compute C n C m — gC„_iC m +i from this by replacing m — > n — 1 and 
n — > m + 1. In particular, 

gC^iC,^! - C„C m =(-l/9)^- 2 ^^?- M+1 vi+r, ffl+ i +1 )^^ • 

r>0 s>0 

The identity —SQ)-x,a+i) — s (a,b) an d the commutation of h then implies our 
claim. □ 

An important consequence of this result is that if a is a composition of length I, 
then C a [X]q] can be written as a linear combination of the Cx[X;g] where A are 
partitions that also have length I. 

Remark 3.3. The symmetric function Cn^[X;q] can be expressed in terms of 
C( 3 !) [X; q] and C( 2 2) [X] <?] using this commutation relation since gCiC3 = C2C2 + 
C 3 C 1 -gC 2 C2. Consequently, C {h3) [X;q} = (1/g - 1)C (2>2) [X; q] + 1/<?C(3,1) [X; q). 



The relation of C to B given in (3.5) enables us to derive an identity on B from 



Theorem 3.2 In particular, we simply apply uj to (3.7 1 and replace q by 1/q. 



Corollary 3.4. For rn e Z. 

B m B„ — gB m+1 B„_! = gB„B m — B„_!B m+1 . 
In particular, letting n = m + 1 gives 

B TO B m+ i = q M m+ iM m . 

In fact, we can also pin down commutation relations between the B and C oper- 
ators if m + n > (note, the relation does not hold when m + n < 0). 

Proposition 3.5. If m + n > 0, then 

(3.12) B„C m = q c m n n . 

Proof. We use identities ( |3.9[ ) and ( |3.10 ) and compute an expression for B m C„: 



=(-i/9)- 1 E ES-^^Mi - 9K-M 1 - 

r>0 s>0 i>0 

= (-l/9)^ 1 ^2^2(-l) r q-'e miJr K+ a ht ± hl ± 

r>0 s>0 

+ E E £(-i) r4 V'<wr-Hft»+.-i(i - q)K x ht. 



i>l r>0 s>0 
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Analogously, we also have the equations h^e m — J2i>o e m-i e i[^ — <z]^r-i anc ^ 
e r [l — q] = (— q) r h r [l — q] if r > 0. From this we derive a similar expression for 



<-l/g) n - 1 £££(-l)V' + X+.e m+r _<e i [l - g]^^ 

s>0 r>0 i>0 
s>0 r>0 

+ (-l/g)"- 1 £ X! E(- 1 ) r+i+1 «" Se ™+-^«+ s +i(l - <z)^ X ft? X - 



i>l s>0 r>0 

Their difference is 



-{l-q){-l/q) n - 1 Y,T.1~^- i y e m+rK +s h^h'i 1 - 

s>0 r>0 



r>0 s>0 \i>l 



r>0 s>0 \i>l 



In fact, the right hand side reduces to zero since m + n > implies that for each 
r, s > 0, m + n + r + s>0 and 



( — 1) T Cm+rhn+s + (~ 1)' +% e-m+r-jh-n+s+i + (~ 1) r+t Cm+r+ a h 
i>l i>l 
m+r 



i——n—s 



by the identity X)f=o( — ^Y e d~ihi = for all d > 0. □ 
Jing's operators generalize operators of Bernstein (see |Mac95j ). defined by 



(3.13) S(*)P[X] = ^ z m S m P[X] = P 



m£2 



z 



n[zX] 



ra£Z r>0 

These are creation operators for the Schur functions since S \ 1 S \ 2 ■ ■ ■ E>\ t ( 1 ) = s \ [X] , 
and they satisfy the commutation relation 8 OT 8 n = — § n _iS m +i. We can write the 
Schur creation operators in terms of the C a operators, which will help us in §[5] to 
write Schur functions in terms of the C a . 

Proposition 3.6. For m E Z, 

(3.14) S m = (-<z) m_1 E]C m+i e±. 

i>0 
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Proof. We will use the identity h r [(l-q)X] = J2j> h j Mi-j [~qX] = E,j>o(-Q) r ~ jh 3 [^K-j W 
and calculate directly, 

i>0 i>0 r>0 

= E E Et-v^r^^'ww^^-i^ 

r>0 i>0 j>0 
d 

d>0 j=0 r>0 
d 

d>0 j=0 r>0 

= E(' 1 ) _r/i ™+'-[ x ] e ^ = s ™ 

r>0 

where the last equality follows because X^=o(~l) J ^j e d-j — f° r all e? > so the 
remaining sum is only the part where d — 0. □ 

Remark 3.7. In the reference [GXZlOj . the operator C is presented in a slightly 
different but equivalent expression. We note that a series f(z) — J2 n ez fn 2 ™ has 

the property that f(ez/q) = (—l/q) a f(z) 



l a P[X] = -qP 



x 



.(1-9) 



= -q(-l/q) a P 
= {-l/q) a - l P 



x + 
x- 



. For this reason, 

n[e(z/q)X] 
(1-9) 



qz 

1-1/g 

z 



n[zX] 

Q[zX] 



4. The combinatorics of V applied to Hall-Littlewood polynomials 

Recall that in the special case that a is a partition, B a [X;q] and C a [-X';g] are 
closely related to the Hall-Littlewood symmetric functions. It was conjectured in 
BGHT99, Conjecture II and III] (partially attributed to A. Lascoux) that applying 
V to a Hall-Littlewood polynomial produces a Schur positive function. Our main 
discovery is that including all compositions a in the study of V(B a [X]q]) and 
W(C a [X;q\) leads to a natural refinement for the combinatorics of Dyck paths. 
Moreover, our combinatorial exploration led us to discover new symmetric function 
identities. 

One useful tool in the exploration of the operator V is the fact that V 9=1 is a 
multiplicative operator. Since we can deduce from the operator definitions of our 
symmetric functions that B a [X; 1] = e Q [X] and C a [X; 1] = h a [X], we have 



V^ 1 (B a [X;l}) = V« =1 (e ae [X])V^ (e ae _ l[x] )■■■ V^ 1 (e 0l [X]) 



and 



V« =1 (C a [X; 1] ) = V« =1 (h ai [X]) V« =1 (h a2 [X])--- V =1 (h ae [X]) . 

From this we can deduce the coefficient of e n [JT]. In particular, the coefficient 
of e n [X] in V(e n [X]) and in V(/i„[X]) is the g,i-Catalan numbers C n (q,t) and 
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C n -i(q,t), respectively. Thus, the coefficient of e„[X] in V q=1 (B a [X; 1]) and in 
V q=1 (C a \X] 1]) is WiC ai (l,t) and Y[iC ai -i(l,t) respectively. The combinatorial 
interpretation for C n (l,t) then gives combinatorial meaning to these coefficients. 
Namely, (e„[X], V q=1 (B a [X; 1])) is the ^-enumeration of Dyck paths (with weight 
t raised to the area) which lie below the staircase consisting of a.\ steps up and 
over, CH2 steps up and over, etc. and (e n {X], \7 q=1 (C a [X; 1])) is a i-enumeration of 
Dyck paths which touch the diagonal only in rows 1, l + a±, 1 + a\ + a 2 steps, etc. 

Proposition 4.1. For a a composition of n, 

(4.1) (V q= \B a [X;l]),e n [X])= £ t aiea ^ 



D<DP(a) 



y ^arca(.D) 



and 

(4.2) {V q = 1 (C a [X;l]),e n [X]) = 

touch(Z))— a 

Remarkably, we have empirical evidence to suggest that in general, there is 
a combinatorial interpretation for the coefficient of e n [X] in \7(B a [X;q\) and in 
V(C Q [X; q]) that naturally generalizes the beautiful combinatorics of the q, i-Catalan. 

Conjecture 4.2. For a \= n. 

(4.3) {V{B a [X-q]),e n [X]) = t axeat - D) q din ^ D ' )+doSa(D) . 

D<DP(a) 

Conjecture 4.3. For a |= n, 

(4.4) (V(C a [X;q]),e n [X}}= ]T t arca(Z» g dinv(Z»_ 

touch(X))— a 

Our work was inspired by the work of jBDZlOj where they considered coefficients 
W(B^[X: q\) for A a hook partition (since for that case doff-^-(D) = 0). The innova- 
tion in these identities is to consider symmetric functions indexed by compositions 
which allowed us to conjecture the action of V on a spanning set of the symmetric 
functions. 

More generally, we have conjectures for the expansion of W(B a [X; q\) and V(C Q [X; q\) 
into monomials. 

Conjecture 4.4. 

(4.5) \7(B a [X;q})= ^ ^ ^rea^yinv^-Woff^D)^ 

D<DP{a) w£WP D 

Conjecture 4.5. 

(4.6) V{C a [X-q])= ^rcaPyinvM^ 

touch(D)=a weWPn 



By the arguments in TfHLRU05] (see also |Hag08[ p. 99]) Conjecture 4.4 and 4.5 



imply Conjecture 4.2 



conjecture since £?(„) 



and 4.3 The case a = (n) of (4.5) reduces to the shuffle 



X;q] = e n [X]. Also, because of the expansion of S( n _ fe ,i fc ) 



in Proposition 5.3 in the next section, (4.6) implies the special case of the Loehr- 
Warrington conjecture [LW08[ Conjecture 3] involving the action of V on the Schur 
function S(„_fc.i fc )- 
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We will prove in the next section that Conjectur e |4.4| and |4.5| are equivalent to 
each other (and by consequence Conjecture 4.2 and |4.3| are equivalent as well). In 
work building on our results here, |GXZ10| with contributions from |HiclO| proved 
Conjecture |4.3| 



5. Symmetric Function Identities 



The exploration of q, i-Catalans led [UH01 to the special symmetric function 
elements E n ^ k [X;q], defined by the algebraic identity 



X 



± { f^E^ k [X-q] 



where (z; q) k = (1 — z)(l — qz) • •■(].— q z). These elements play a fundamental 
role in the proof that the q, t-Catalan polynomial is the q, t-enumeration of Dyck 
paths as given in (2.8). Namely, the proof follows by showing that 
(5.1) 

n—k r 



(VE n , k [X;q],e n [X]) = q^t n - k J2 



r=0 



r + k — 1 
r 



(V(E n - k , r [X;q]),e n - r [X]) 



where 



(<nq)k(q;q)n-k 



, and the combinatorial interpretation for (VE„ tk [X; q], e n [X] 



in terms of Dyck paths satisfies the same recurrence. 

In particular, the coefficient of e„[X] in W(E nk [X;q\) q, i-enumerates the Dyck 
paths which touch the diagonal k times. From this, Conjecture |4.3| leads us to 
expect that 

(e n [X],V(E n , k [X;q})} = £ (e n [X], V(C a [X; <?])) . 

a\— n,£(a) — k 

In fact, we have discovered much more generally that 
(5.2) E ntk [X;q}= £ C a [X;q}. 

a|=r> 

This section is devoted to proving this surprising result, which suggests that the 
C a [X;q] are the building blocks in <7,i-Catalan theory. 



Remark 5.1. A key step in the proof of our Conjectures |4.2| and 4^ relies on 
extending the recurrence (5.1| to involve Dyck paths which touch the diagonal at 
certain points. This is carried out in GX Z1Q] , 

Our point of departure is to give a simple expression for e n [X] in terms of the 
Hall-Littlewood symmetric functions C a [X;q]. 



Proposition 5.2. 

(5.3) 



e n [X]=Y J C a [X;q}. 



Proof. Assume by induction on n that equation (5.3) holds (the base cases of n = 
and 1 arc easily verified). Since the operator S m is a creation operator for the Schur 
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functions, by (3.14| we have 

e n [JC] = a ( i» ) [X]=S 1 (s ( i»-i ) [X]) = 53Ci +< s (1 -«-i ) [JC] 

i=0 

Which, by induction, gives 

n-l 

e « W = E E Ci+i^at^; 9] = E • 



i=0 a| = ri — i— 1 



ah 



□ 



Proposition |5.2| can be stated in a more general form, suggesting that any Schur 
function may expand nicely in terms of our Hall-Littlewood spanning set. 

Proposition 5.3. For < k < n, 

a\=n 
a 1 > n — fc 



Proof. Again using that § is a Schur function creation operator, by (3.14) we have 

k 



i=0 



The previous proposition then implies 

S(n-k,l")[X] = (-q) n - k - 1J £C n _ k+i I £ C Q [X;q] 

k 

= (-q) n - k - 1 J2 E C (n _ fc+i>a) [X;g] = (- g )"- fe - 1 £ C a {X;q} 



i=0 ct\=h— i 



a|=n 
a.\~>n—k 



□ 



We are now in the position to prove that E n ^[X;q] can be decomposed canoni- 
cally in terms of the C a [X; q]. 



Proposition 5.4. For < k < n, 



(5.4) 



E ntk [X;q}= J2 



-n{n)-k+M(n) 



k 



C»[X;q], 



where M(ji) = £™ =1 ( m ^ )+1 ) and 



k 



fe^k/riiLlfe^mid*)- 



Proof. Recall the expansion of the elementary symmetric functions in the Macdon- 
ald basis is given by (see jGHOlj ) 



X- 



1-z 



E" ! 

fihn 



H^X-q^H^l-z^l-t);^} 



h^q,t)h'^q,t) 
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where h^(q,t) = Uce^(l a{c) ~ t l( - c)+1 ) and h'^q,t) = Y\ ceii {t l{c) - q a{c)+1 ). When 
t = 0, these expressions reduce to 



M^o) = ;Q(<7 a(c) -° i(c)+1 ) = 



and 



^(?,o) = n a-9 a(c)+i ) n (-<z a(c)+i ) 



i(c)=0 



Z(c)#0 



Therefore since H^X; q, t] = H^i [X; t, q], when we set t = everywhere we have 



(5.5) e„ 



X 



1-z 



= ^(-i)"- Ml g- n 



-2n(//)+M(//) -"M 



H„/[X;0 J g]5„[(l-z);g,0] 



nr=ite9) 



1-9. 

Now the evaluation 

(5.6) i^[(l-z);<7,t] = n(l-^' (c V' (c) ) 

C£jtl 

also yields 

fl^[(l-z);flf,0] = (z;g) w . 
Thus, replacing /i by // in (|5.5[), and thereby exchanging /Ui and gives 

1-z' 



(5.7) 



X- 



1-9 



^H fJ ,[X;0,q](z;q)e(, i ) 

n"=l(9; 9)m,( M ) 



Since ff M [X;0,g] = (-IJ^W^mI+^Wc^X;^ we have 



X- 



1-z 

I 3 ? 



ktoih fa q 

e(p)=k 



-fc-ra(»+M(/i) ^[^i9](9;9)fc 

nLi(9;9)m,( At ) ' 



which implies our claim. 



□ 



The g-bmomial coefficients that appear in equation (5.4) suggest that there is a 
relation between the terms of the C\[X; q] basis and subsets of a k element set. It 
turns out that Proposition |5 ,4| can be more cleanly written over compositions using 
a different expansion. 

Corollary 5.5. For < k < n, 



(5.8) 



E n , k [X;q} = C a [X-q] 



a\—n 

l(a)=k 



Proof. Using the straightening relations of the C m operators, if a is a composition 
of n and A is a partition of n such that £(X) ^ £(a), then 



C a [X;q] 



Cx[X;q] 
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Now for £(A) = k, by Proposition 5.4 and the fact that e n [X] = J2k=i E n ,k[X; q], 



E n , k [X;q] 



C*[X;q] 



eJX] 



\C x [X;q] 
= ]T C a [X;q] 

a\—n 



Cx[X;q] 



c c[X;q] 



t(a)=k 



Cx[X;q] 



Furthermore if £(\) ^ k then 
E n , k [X;q 



Cx[X;q\ 



= 0= Y c a [x- q ] 



t(a)=k 



Cx[X;q] 



Since the functions C\ [X; q] are a basis this implies that E n k [X; q] a\=n C a \X;q\. 

l{a)=k 

□ 



We have seen in (3.5) that C is naturally related to B. Here we pin down the 
relationship between the symmetric functions B a [X; q] and C a [X; q\. A by-product 
of this identity is that Conjecture |4.5| implies Conjecture |4.4| 



Theorem 5.6. For n > and any composition a \= n, 
(5.9) B a [X-q] = Yl A ° Sa(DPm C,[X-A. 

/3<a 

Proof. We show this result by induction on the number of parts of a. The base case 
follows since B m (l) = e m LY] which is equal to 'Y^ 1 ^ =m C 1 [X;q] by Proposition 



5.2 



Assume by induction that (5.9) holds for a composition a of length £ and consider 
a composition (m, a). We then have 

(5.10) B (a<m) [X;q] =M m (B a [X;q}) = £ q doS ^ DP ^M m (Cp[X; q}) . 

/3<a 



Now consider B m (Cp [X ; q] ) = B m o 



°C/3 2 o • • • o Cp e(ff) (1). The commutation 



relation between the C„ and B m from Theorem 3.5 implies 

m m (C p [X: q}) = q e ^C 01 o C fe o • • • o C^, o B m (l) 
By Proposition |5.2[ we then have 
(5.11) 

(5.12) 



t (Cp[X; q]) = q e ^C Pl o C ft o • • • o C Ptw ( £ C 7 [A; g]) 



7|— m 



= gW^C (/3 , 7) LY;g]). 

■y\—m 

Putting ( |5.12D into ( |5.10[ ), we thus find that 

B {a , m) [X;q] = 2 tf^-^WJ+'W 2 <W*5«I • 



fi<a 



7^m 



For each term in the sum, the composition (/?, 7) is finer than the composition 
(a,m). Moreover, if we let be the number of times that DP(JS) touches the 
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diagonal below the i th bump of the Dyck path DP(a), then doff( Q . m ) (DP((3, 7)) = 
Ei=i r< (%) + 1 - i) = E£°i + Ei=i * = doff Q (DP) + £(?). □ 



To prove that that Conjectures |4.5| and |4.4| are in fact equivalent, we need to 
express C a [X; q] in terms of Bp[X\ q]. 



Lemma 5.7. Let 7, a be compositions with 7 < a. Then 



(-l) £ ( Q )- £ (' 9 )^( a )- £ (/ 3 )+ doff ^( DP (7))-doff fr (DP('fl)) = J tfl < a 



7 </3<o 



1 if 7 = a 



Proof. First assume that 7 < a and consider the difference of the descent sets 
Des(7)\Des(a) = {i 1 ,i 2 , ■ ■ ■ , id}- There are 2 d compositions f3 such that 7 < (3 < a 
and we will pair them up with a sign reversing involution. 

If i\ £ Des(/3), let /3 be the composition with Des(/3) = Des(/3)\{zi} (the terms 
with ii € Des(/3) will match with the terms i\ ^ Des(/3)). There is some r > 1 such 
that ai = a2 = /?2, • • • j <%r > fir because Des(/3) contains the descent i\ that is 
not in Des(a). Calculating directly we have that, 

1(a) - £{$) = £{a) - £0) - 1 
doff p (DP(j)) = doff^(DP( 7 )) + r 

-dofffcCDPtf? )) = -dafffc (£>P(0 )) - r + 1. 

Therefore 

£(a)-€(/3)+doff, 3 (DP(7))-dofft r (CP(/3)) = ^(a)-^( / 8)+doff^(£>P(7))-doflF t (DP( 

and the signs of these terms are different in the sum. This provides a sign reversing 
involution and hence those terms with touch(P) < a sum to matching those 
terms with Des(/3) which include the smallest descent. 

Now for those terms with touch(P) = a we have 7 = (3 = a and 

£{a) - e(f3) + doff (3 (PP(7)) - doS^(DP(%) = 

since doS a (DP(a)) = ■ D 

Theorem 5.8. For n > and for any composition a (= n, 

(5.13) C Q [X;g] - ^(-g)^)-^),-^^^))^^^; g] . 

,3<a 



Proof. By Theorem 5.6 we have 

^(-gj^W-Wg-^COF^))^^.^ 

/3<a 

/3<a 7<,9 
= £<? 7 [X;g] 2 (_ g )*(a)-^) ? -daff fr (iJF(^)) g doff ff (DP( 7 )) i 
7 3 

T</3< Q 

and our claim now follows by Lemma |5.7| □ 
Theorem 5.9. Conjecture\4- 5\ is true if and only if Conjecture\4-4\ * s true. 
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Proof. Theorem 5.6 gives B a [X; q] in terms of Cp[X; q], to which we apply V: 
W(B Q [X;q}) = J2 q d °^ DPm V(C p [X;q}) . 

f)<a 

Given that Conjecture |4.5| holds, we then have that 

V(B a [X;q}) = J2 E E t^ D \ diav ^+ doS ^ DP ^x w 

B<a o wtWPn 

touch(D)=(3 

_ £&rcn(D) qdinv(w)+doff a (DP(/3)) x w 

D<DP(P) weWPn 



On the other hand, assuming Conjecture |4.4| holds, Theorem 5J3 gives 
V{C a [X;q]) = ^ ( _^(»)-« f Mt(^(^)) V ^ [I;5]) 

f)<a 

(5.14) 

_ y~" t^c a (D)^_ q Y(a)~i(l3) q dm V (w)+doff (D)-doH^(DP(^)) x w 

P<a D<DP(j3) w£WP D 

For a Dyck path D in the sum, let 7 = touch(D). Note that D < DP(/3) implies 
that 7 < P < a, and thus we may rearrange sums as follows: 

V" V" (_ q y(a)-m q do«p(D)~dott^(DP(l3)) 
/3<a D<DP(P) 

= V (-i)Ha)-m q na)~m+<ioffe(D)-dos^(DP(t)) _ 

7<n D (3 

touch(D) = 7 7</3<a 



Lemma 5.7 allows us to conclude that (5.14) reduces to Conjecture 4.5 □ 



Corollary 5.10. Conjecture \4-S\ is true if and only if Conjecture \4-3\ is true. 
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